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(57) Abstract: A method of decoding a data signal using a low density parity check matrix, comprising a first stage of iteratively 
carrying out horizontal and vertical decoding steps to form a matrix {5qik} and a second stage of testing for parity, characterized in 
that the elements of {5qu} are updated sequentially, such that each element {5quc} is employable for subsequent calculations as soon 
as it is updated. 
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DECODING OF LOW DENSITY PARITY CHECK CODES 

Field of the Invention 
The present invention relates to decoding of low density parity check 
5 codes and more particularly but not exclusively to a method and apparatus for 
decoding of low density parity check codes that is suitable for digital data 
communication such as multimedia. 

Background of the Invention 

10 Error correcting codes are widely utilized to obtain reliable 

communications over noisy channels. Generally speaking, a linear error 
correcting code C can be described by a parity-check matrix H satisfying 
Hx = 0 for any codeword xe C. H is an mxn matrix where n is the size of a 
codeword and m is the number of linear constraints that must be satisfied by 

15 each code word. Each row of H therefore represents a linear homogeneous 
parity-check equation. Low-density parity-check (LDPC) codes are a particular 
class of linear error correcting codes characterized by a highly sparse parity- 
check matrix. Typically, in a matrix having a relatively large row length, the 
entire row may consist of just three ones, the remainder being zeroes. 

20 LDPC codes were originally introduced and investigated by Gallager in 

1962, c.f. R.G. Gallager , "Low-density parity-check codes", IRE Trans. Info. 
Theory, vol. IT-8, pp 21-28, 1962, the contents of which are hereby 
incorporated by reference. 
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A problem with the use of low density parity check matrices has been to 
provide a method of decoding, and one of the most significant features of 
Gallager's work is the introduction of iterative decoding algorithms. He 
showed that, when applied to sparse parity-check matrices, such algorithms are 
5 capable of achieving a significant fraction of the channel capacity at relatively- 
low complexity. Furthermore, the number of computations per bit per iteration 
is independent of the block length n . 

Since Gallager's prominent contribution, LDPC codes have been 
rediscovered and further investigated by Tanner, Wiberg, Mackay and Neal and 
10 others. Details of these investigations may be found in R.M. Tanner, "A 
recursive approach to low complexity code", IEEE transactions on information 
theory, 27)5), pp 533-547, 1981, and D.J.C MacKay and R.M. Neal, "Near 
Shannon limit performance of low-density parity-check codes", Electronic 
letters, vol. 32, pp. 1645-1646, 1996, the contents of which are hereby 
1 5 incorporated by reference. 

Important modifications to Gallager's codes include: 

1) Davey and MacKay, cited in M.C. Davey and D.J.C Mackay, "Low- 
density parity-check codes over GF(q)", IEEE communication letters, vol.2 , 
No 6 m, 1998, the contents of which are hereby incorporated by reference. In 

20 this citation, there is proposed a non-binary version of LDPC codes; 

2) Gallager considered regular codes whose parity-check matrix had 
fixed row and column weights. These constraints can be relaxed to produce 
irregular LDPC codes having a variety of row and column weights as described 
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by Mitzenmacher et. al cited in M. G. Luby, M.Mitzenmacher, M.A. 
Shokrollahi and DA. Spielman, 'Improved low density parity-check codes 
using irregular graphs and belief propagation", proceedings of the IEEE 
International Symposium on Information Theory (ISIT) , pp. 117, 1998, the 
5 contents of which are hereby incorporated by reference.. 

Known decoders include the maximum likelihood decoder and the soft 
output decoder. The more widely used of the two, the maximum-likelihood 
decoder involves finding a most probable codeword (where the likelihood of 
the codeword is dependent on the channel model). The soft-output decoder 

10 differs from the maximum likelihood decoding in that it provides an a 
posteriori probability for each symbol of the codeword. A problem, however* 
is that the soft-output decoder is typically more computationally involved than 
the maximum-likelihood decoder. 

Gallager therefore proposed the iterative decoding scheme referred to 

15 above, based on the (later termed) belief propagation method, details of which 
are discussed in J. Pearl , "probabilistic reasoning in intelligent systems: 
Networks of plausible inference", Morgan Kaufinann, 1988, the contents of 
which are hereby incorporated by reference. In this citation the belief 
propagation method, which approximately converges to the a posteriori 

20 probability of each symbol, is explained. The method relies on a graph-based 
representation of codes, where the decoding can be understood as message 
passing in a factor graph. Belief propagation produces exact probabilities in 
case of a non-cyclic graph. Unfortunately, the graph associated with an LDPC 
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code is cyclic and therefore belief propagation may produce inaccurate 
probabilities. Nevertheless, Gallager's decoding algorithm gives good 
empirical performance since, in particular, the end product is the decoding, and 
so the posterior probabilities need not necessarily be exact. 
5 A brief description of Gallager's iterative algorithm follows. For brevity 

of exposition, we consider the binary case. The extension to the non-binary 
case is straightforward. 

Gallager's iterative decoding for LDPC codes 
10 Gallager's algorithm has two alternating components commonly referred 

to as the horizontal and vertical steps. More specifically, two binary 

distributions, q and rik , associated with the non-zero elements h ik of the 

sparse parity-check matrix H, are iteratively updated. The quantity ^(0) 

represents the probability that the k'th bit of the transmitted codeword is zero 
15 given the information obtained from all the parity equations other than the Tth 
equation. In a similar manner, r lk (Q) represents the probability that the Tth 

parity-check equation is satisfied given that the k'th bit is zero and all the other 
bits are statistically independent, with associated distributions # ■■•# jB - 

Assuming that the codewords are used with equal probability on an arbitrary 
20 binary-input continuous-output channel, Gallagers algorithm can be described 
as follows. 
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1. Initialization 

Denote by p (0) the prior probability that the lc th bit of the transmitted 

codeword is zero. This probability can be calculated from the received vector 
corresponding to the transmitted codeword and the channel model. For each 
5 non-zero entry h tk of the parity-check matrix H, set: 



2. Horizontal step 

For each non-zero entry h lk of the matrix H: 
1 0 define Sq ik = q^ (0) - q ik (1) and compute 



r*<o)4 a+ n<%<> © 



r t ^\^I[Sq) (2) 



2 



where / runs over the non-zero bit positions of the Fth parity equation 
(i.e. h a * 0), excluding the lc th position. 

15 1 3. Vertical Step 

For each non-zero entry h ik of the matrix H, update q in the following 



manner: 



^ (0)=a A (0)rT ^ (0) ® 
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4 (t (i)=«/? t (i)n r , t (i) (4) 

where j runs over the parity equations for which h Jk * 0 , and the scalar 
a is a normalization factor chosen such that q^ (0) +gr^ (1) = 1 . 

Note that an auxiliary buffer is required for storing the values y jh 

5 computed in (1) and (2), for the calculation of q as defined in equation (3) 
and (4). 



4. Tentative decoding 

A single iteration comprises of updating the 8 q based on the outcome 

10 of the previous iteration, an application of the horizontal step and then 
application of the vertical step (except for the first iteration where Sq is 

* 

initialized based on the channel measurements). At the end of any iteration 
(including the initialization step) one can also update the soft-output decision 
(i.e. the posteriori probability) of each bit: 

15 q k (0)=ap k (0)TI rfit (0) (5) 

q k (D=a pfi)Ilrjt® (6) 

J 

where j runs over the parity equations for which h Jk *Q. Using (5) and 
(6), the value of the k'th transmitted bit x k can be estimated as 



ri ,,o)>«.<m • 



0 otherwise 
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In this manner a tentative bit-by-bit decoding is performed and a 
vector x is obtained. If Hx = 0 , Le. if 3c is a codeword, the decoding algorithm 
halts declaring x as the output Otherwise, the iterative process continues by 

i 

returning to Step 2 above. The decoding procedure terminates by declaring a 

♦ 

5 decoding-failure, if some maximum predetermined number of iterations (e.g. 
1 00) occurs with no successful decoding. 

As mentioned above, an auxiliary buffer is required for storing the 

values rjk computed in (1) and (2), for the calculation of q k as defined in 

equation (3) and (4). Such a buffer requires a large amount of additional 
10 memory and control and thus results in an undesirably high time per iteration. 

Furthermore, the number of iterations until a result is achieved is also 

undesirably high. Both of these points render the method unsuitable for use 

with high volume data such as video and other multimedia related data. 

US Patents 6,081,918 and 6,073,250 refer to the use of low density 
15 parity check matrices in recovering data that has been lost in transmission. It 

does not consider the problem of improving decoding efficiency. 

US 6,081,909 discusses the use inter alia of low density parity check 

matrices for encoding data. Again it does not deal with the question of efficient 

decoding. 

20 Summary of the Invention 

It is an object of the present invention to overcome the above-mentioned 
limitations and to provide a method which is suitable for use with high volume 
data such as multimedia-type data which needs to be processed rapidly. Such a 
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method may be useful in for example applying multimedia to the forum of 
wireless communications. 

According to a first aspect of the present invention there is a method of 
decoding LDPC encoded data comprising: 
5 solving parity check equations defined by a low density parity check 

matrix having a plurality of rows, until parity is reached, for a data matrix 
iteratively formed by sequential updates of probability differences directly into 
a single probability difference matrix. 

In a preferred embodiment the step of forming a sequential update 
10 comprises a step for each row of said parity check matrix of forming a 
probability difference product 

where bq& is the difference between the probabilities that the i* element 
in the k* row is a "1" and a "0". 
15 A preferred embodiment further comprises the step of forming, for each 

non-zero entry of the low density parity check matrix: 

q^p^qfS) 

Preferably, the probability difference matrix is formed by calculating for 
20 each one of a plurality of positions in said matrix the differences between #(0) 

and #(1) for said respective position. 

Preferably there are provided steps of 



8 



WO 02/37731 PCT/IL01/01017 



forming said data matrix {X} using {Sq^ }, 

testing the data matrix {X} for parity, and 
accepting the matrix {X} as a final data matrix if parity is detected. 
In an embodiment further iterations are carried out using newly 
5 calculated values of Sq ik at each stage until parity is detected 

A preferred embodiment comprises the step of ending decoding if parity 
is not detected after a predetermined number of iterations and declaring that 
the incoming signal is too corrupted for decoding. 

According to a second aspect of the invention there is provided a 
10 method of decoding a data signal using a low density parity check matrix, 
comprising a first stage of iteratively carrying out horizontal and vertical 
decoding steps to form a matrix {Sq^} and a second stage of testing for parity, 

characterized in that the elements of {Sq Jk } are updated sequentially, such that 

each element 8q ik is employable for subsequent calculations as soon as it is 

15 updated. 

The method preferably comprises forming 



where Sq^ is the difference between the probabilities that the i element 
in the row is a "1" and a "0". 
20 Preferably, the method further comprises the step for each non-zero 

entry of the low density parity check matrix of forming: 
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Preferably, the method further comprises the step of forming a matrix 
{ Sq lk } of differences between £(0) and 0(1). 

Preferably, the method further comprises the steps of 
5 forming a data matrix {X} using { Sq ik }, 

testing the data matrix {X} for parity, and 
accepting the matrix {X} as a final data matrix if parity is detected. 
Preferably the method comprises the steps of iteratively repeating the 
above steps using the newly calculated values of Sq lk at each stage until parity 

10 is detected. 

Preferably, the step is also provided of ending decoding if parity is not 
detected after a predetermined number of iterations. 

According to a third aspect of the present invention there is provided a 
decoder for receiving a signal comprising data bits and decoding it using a low 
1 5 density parity check matrix, the decoder comprising: 

a probability assignor for assigning to successive incoming data bits 
probabilities of respectively being "1" and being u 0" and for forming a 
probability difference matrix therefrom, 

a probability product difference calculator for producing a probability 
20 product difference for each row of said low density parity check matrix, 
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an updater for updating said respective probability product difference 
and a respective entry of said probability difference matrix for each non-zero 
entry of said low density parity check matrix, 

a decoder for forming a decoded signal based on said updated 
5 probability difference matrix, and 

a parity check unit for checking the parity of said decoded signal. 

Preferably, the updater is operable to repeat said updating until either 
one of a group of conditions is fulfilled, said conditions being that said parity 
check unit indicates that said decoding is successful, and that a predetermined 
1 0 number of repetitions has been reached. 

Preferably, the signal is a high density signal. 

Preferably, the signal is a multimedia signal. 

The signal may be a music signal. 

The decoder may be a part of a 3 rd generation wireless telephony device. 

15 

Brief Description of the Drawings 
For a better understanding of the invention, and to show how the same 
may be carried into effect, reference will now be made, purely by way of 
example, to the accompanying drawings, in which: 
20 Fig. 1 is a generalized diagram showing a data communication link over 

a noisy channel, 

Fig. 2 is a generalized diagram showing matrices including a sparse 
matrix, for use in the present invention, 
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Fig. 3 is a simplified flow diagram showing, as a series of numbered 
steps, an iterative procedure for decoding using a sparse matrix according to an 
embodiment of the present invention, and 

Fig. 4 is a simplified diagram illustrating the difference between the 
5 prior art and embodiments of the invention, in that it eliminates the need to 
store the matrix "r". 

Description of the Preferred Embodiments 
According to a first embodiment of the present invention there is 

10 provided a procedure for soft-output decoding of low-density parity-check 
codes. The decoding procedure is based on a principle known as iterative belief 
propagation, as will be described in detail below. In existing algorithms, as 
described above, two sets of binary distributions are updated iteratively in a 
process in which all the random variables associated with one set are updated 

15 concurrently based on the variables associated with the other set. Thus, an 
auxiliary buffer is required for the updating mechanism. According to the 
present embodiment, the updating of the random variables is performed in- 
place, meaning in the same matrix, thereby avoiding the need for an auxiliary 
buffer. Moreover, while existing decoding methods employ extensive control 

20 mechanisms for administrating the low density matrix, referred to below as the 
sparse-matrix, the approach of the present embodiments, referred to below as 
the in-place approach, completely eliminates the need for such control. The in- 
place approach consequently propagates the updated information much more 
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rapidly. Thus only a small number of iterations suffice for successful 
decoding. 

Reference is now made to Fig. 1, which is a generalized diagram 
showing a data communication link over a noisy channel. A sender 10 encodes 
5 data using an encoder 12 for sending via a channel 14 to a receiver 16 who 
decodes the data using a decoder 18. The data signal is distorted as a result of 
passing through the channel, and noise is added. One of the purposes of 
encoding is to make the data following modulation more resistant to distortion 
and to the addition of noise, and to render it susceptible to error detection and 
10 correction. 

As discussed in detail in the introduction, one of the methods of 
encoding is the low density parity check matrix, which requires decoding using 
an iterative process which can become a relatively high consumer of resources 
if the data being used is particularly dense, tens of thousands of bits in a short 
15 period of time, as with video and other multimedia data. 

Reference is now made to Fig. 2, which is a generalized diagram 
showing matrices including a sparse matrix, for use in the present invention. A 
sparse matrix H represents a series of parity check equations for data X, each 
equation occupying a row of the matrix, and the application of a parity check 
20 based on matrix X should give a result q of zero for error-free data X. The aim 
of decoding is therefore to solve H x X = 0, for X using an iterative technique. 

Reference is now made to Fig. 3, which is a simplified flow diagram 
showing, as a series of numbered steps, an iterative procedure for decoding 
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using a sparse matrix according to an embodiment of the present invention. As 
before, the decoding method is described for the binary case, while the 
extension of the algorithm to the non-binary case is straightforward. 

In the following it is assumed that all codewords are used with equal 
5 probability on an arbitrary binary-input continuous-output channel. 



1. Initialization 101 

Following Gallager's initialization step described above, for each non- 
zero entry h lk of H set: 



20 



and we calculate 



For each parity-check equation / we then calculate 



15 where k runs over all the non-zero entries h tk of the i "th parity-check 

equation. Thus, § is calculated while taking into consideration all the bits that 
are associated with the / parity-check equation. The quantity ^ t of the i 
equation is referred to hereinbelow as the probability difference product of the 



i* equation. 



2. The Horizontal-Vertical Step 102 
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In this step the algorithm entities are updated and re-employed within 
the same iteration for the updating process as described below. 

For each non-zero entry h ik of H, update in the following manner 
(step 104): 

5 qJO) = ap{om(fiq +S? W 

q m Q)-ap k Q)Wq-S? do) 

where j runs over the parity equations for which h Jk * 0 excluding the 

Tth check equation, and where the scalar a is chosen as before. Thus, q^ is 

updated while taking into consideration all the parity-check equations that 
10 include the k'tih bit, excluding the Tth equation. 

As soon as q^ is calculated in equations (9) and (10), it is then possible 

to recalculate Sq tk and then preferably update as defined in equation (8) 
using the updated Sq ik (step 105). It is pointed out that the updating of g ( 

requires merely 2 multiplications regardless of the number of non-zero entries 
15 in the i* check equation (and hence it holds true for any LDPC code). 
Theoretical motivation for the updating method described by equations (9) and 
(10) is given below, in the section headed "Theory". 

3. Tentative decoding 
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At the end of any iteration (including the initialization step above) the 
soft-output (i.e. the posteriori probability) for each bit is preferably calculated 
(step 107) as follows: 

5 q k Q) = ap k (i) Yl{5 q k -Sj) 

where j runs over the parity equations for which h jk * 0 . Thus, q k is 

calculated while taking into consideration all the parity-check equations that 
include the k' th bit. 

The quantities {q k (l)} and {g k (0)} are preferably used to generate a 

10 tentative bit-by-bit decoded vector x (step 108), where each bit jc* is given by 

equation (7). If Hx-0 9 i.e. if 3c is a codeword (step 109), the decoding 
algorithm terminates successfully (step 110), declaring x as the output. 
Otherwise, the iterative process continues by returning to the Horizontal- 
Vertical Step above. The decoding procedure terminates by declaring a 

15 decoding-failure (step 112), if some maximum predetermined number of 
iterations (e.g. 100) occurs (step 111) with no successful decoding. 

The manner in which the parameters are updated during the horizontal- 
vertical step 103-106, is based on the following: 

According to the common implementation of belief propagation 

20 methods, updating of the probabilities is based on the following formulae: 



16 



WO 02/37731 PCT/IL01/01017 



(12) 



Substituting (1 1) into (12) yields: 



q lk (0) = 



= a A(o)-n 



1 



2 Sq 



Jl 



J 



i 



•n<^ ;i + n^ y ,) 



(13) 



In a similar manner: 



(14) 



Recalling that = Yl & q ik , and since the normalization factor a can 

10 absorb the common multiplicands in both (13) and (14), the following 
equations are obtained 



q^ap^uiSq^S? 



15 



where a is chosen to satisfy aq lk {\) +aq lk (0) = 1 . 
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Hence the simplified updating of the present embodiment becomes 
possible. 

Reference is now made to Fig. 4, which is a simplified diagram 
illustrating the difference between the prior art and embodiments of the 
5 invention, in that it eliminates the need to store the matrix "r". A first process 
block 200 illustrates the prior art in which the matrix q is converted firstly into 
a buffer matrix r and the matrix r is then converted into the matrix q. A second 
process block 202 illustrates the preferred embodiments of the present 
invention in that the matrix g is converted directly into the matrix q without the 
1 0 need for intermediary buffer matrix r. 

In the prior art of LDPC decoding methods, all the relevant parameters, 
namely {Sq lk } , are updated concurrently. Hence, the updating of each element 

Sq^ is based on values that do not change in the course of a single iteration. 

These values may become stale as more and more elements are updated* By 
15 contrast, with in-place decoding, as soon as 5q ik is computed, it is used (within 

the same iteration) for updating all the subsequently computed parameters. This 
approach propagates the influence of an updated element on the other 
parameters in a rapid manner. Consequently, the convergence of the iterative 
algorithm is accelerated. In other words, on the average, less iterations are 
20 required for successful decoding. 

The above-mentioned result, of accelerated convergence, is difficult to 
prove analytically, however the empirical results of a simulation, that 
demonstrate that accelerated convergence in fact occurs, are presented in table 
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1. The simulation assumes a binary rate l A LDPC code of block length 13000 
bits, and the results are summarized in Table 1. The average number of 
iterations required for the prior art and the proposed in-place decoding method 
are compared as a function of the noise level. 



Eb/No 


# 


# 




iterations 


iterations 


MRl 
l aD J 








prior art 


in- 




[Gallager] 


place 






decoding 


5.5 


4.5 


3.1 


5.2 


5.0 


3.2 


4.9 


5,5 


3.7 


4.7 


6.1 


4.0 


4.4 


7.4 


4.3 


4.3 


10.9 

V 


5.4 



5 Table 1: Rate Y* LDPC code, block length 13000 bits, A comparison of 

the average number of iterations required for convergence 
Theory 

The following equations show the theoretical justification for the 
manner in which the parameters are updated during the horizontal- vertical 
10 step 103-106 according to the above-described embodiment According to 
the common implementation of belief propagation methods, updating of the 
probabilities is based on the following formulae: 

19 



WO 02/37731 



PCT/IL01/01017 



(ii) 



(12) 



Substituting (1 1) into (12) yields: 



1 



? tt (o)=«p t (o>n-a+nw 



j*i l*k 



1 



2-<? 



V / j 



■ tf ^ ) ' n d7' n ^ +n ^ 



In a similar manner: 



(13) 



(14) 



Recalling that St^Tl?*!^ s * nce * e normalization factor a can 

absorb the common multiplicands in both (13) and (14), the following 
equations are obtained 
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where or is chosen to satisfy aq ik (1) (0) = 1 . Thus updating of the 

matrix according to the above-described procedure becomes possible. 

The above embodiments thus improve upon prior art iterative decoding 
methods for LDPC codes. The main procedural difference is in the process of a 
5 single iteration as described above. An array {Sq^ is used to pass information 

from one iteration to the next. As noted in Step 3 of Gallager's algorithm, the 
elements in this array need to be updated in each iteration. In the prior art, all 
the elements are updated concurrently based on equations (3) and (4). This 
requires an auxiliary buffer for storing the values {r {k } computed in equations 

10 (1) and (2). By contrast, according to the above-described embodiments, the 
elements of {Sq tk } are updated sequentially and each element {Sq lk } is 

employed for subsequent calculations as soon as it is updated. The methods of 
the preferred embodiments are hence referred to as in-place decoding. The 
preferred embodiments have several inherent advantages: 

15 1) A small buffer, whose size is proportional to the number 

of parity-check equations, is employed, rather than the one required for 
saving the data {r ik } whose size is proportional to the number of non-zero 

elements in H. 

2) The excessive control mechanism required for 
20 administrating a large sparse matrix is preferably avoided due to the 

sequential nature of the in-place procedure. 
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3) Updated information preferably propagates rapidly 
through the graph representation of the code and therefore the computed 
probabilities are more accurate. 

4) The average number of iterations required for successful 
5 decoding and hence the decoding delay and the overall decoding 

complexity (operations per decoded bit) is preferably considerably 
reduced. 

There is thus provided a method of decoding of received signals which 
have been encoded using LDPC matrices, which method does away with an 
10 intermediate matrix and which leads to earlier convergence of decoding 
iterations. 

It is appreciated that features described only in respect of one or some of 
the embodiments are applicable to other embodiments and that for reasons of 
space it is not possible to detail all possible combinations. Nevertheless, the 
15 scope of the above description extends to all reasonable combinations of the 
above described features. 

The present invention is not limited by the above-described 
embodiments, which are given by way of example only. Rather the invention 
is defined by the appended claims. 
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Claims 



We claim: 



5 LA method of decoding LDPC encoded data comprising 

solving parity check equations defined by a low density parity check 
matrix having a plurality of rows, until parity is reached, for a data matrix 
iteratively formed by sequential updates of probability differences directly into 
a single probability difference matrix. 

10 

2. A method according to claim 1, wherein forming a sequential 
update comprises a step for each row of said parity check matrix of forming a 

probability difference product = H 

where is the difference between the probabilities that the i ft element 
15 in the k & row is a "1" and a "0". 



3. A method according to claim 2, further comprising the step for 
each non-zero entry of the low density parity check matrix of forming: 

20 q^ap^Wfiq-S? 
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4. A method according to claim 3, wherein said probability 
difference matrix is formed by calculating for each one of a plurality of 

positions in said matrix the differences between #(0) and q(l) for said 

respective position. 

5. A method according to claim 3, further comprising the steps of 
forming said data matrix {X} using { Sq tk }, 

testing the data matrix {X} for parity, and 

accepting the matrix {X} as a final data matrix if parity is detected. 

6. A method according to claim 5, comprising the steps of repeating 
the steps of claims 2 to 5 using the newly calculated values of Sq ik if parity is 

not detected. 

7. A method according to claim 6, further comprising the step of 
ending decoding if parity is not detected after a predetermined number of 
iterations. 

8. A method of decoding a data signal using a low density parity check 
matrix, comprising a first stage of iteratively carrying out horizontal and 
vertical decoding steps to form a matrix {Sq lk } and a second stage of testing for 

parity, characterized in that the elements of {Sq ik } are updated sequentially, 
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such that each element Sq^ is employable for subsequent calculations as soon 
as it is updated, 

9. A method according to claim 8, comprising forming 

k 

where Sq* is the difference between the probabilities that the i & element 
in the k* row is a "1 " and a "0". 

10. A method according to claim 9, further comprising the step for 
each non-zero entry of the low density parity check matrix of forming: 

q t <t»-*p t W>npqsS? and 

11. A method according to claim 10, further comprising the step of 
forming a matrix { Sq lk } of differences between #(0) and q(l ). 

♦ 

12. A method according to claim 1 1 , further comprising the steps of 
forming a data matrix {X} using { Sq ik }, 

testing the data matrix {X} for parity, and 

accepting the matrix {X} as a final data matrix if parity is detected. 
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13. A method according to claim 12, comprising the steps of 
repeating the steps of claims 2 to 5 using the newly calculated values of 5q ik if 

parity is not detected. 

■ 

5 14. A method according to claim 13, further comprising the step of 

ending decoding if parity is not detected after a predetermined number of 
iterations. 

15. A decoder for receiving a signal comprising data bits and 
10 decoding it using a low density parity check matrix, the decoder comprising: 

a probability assignor for assigning to successive incoming data bits 
probabilities of respectively being "1" and being "0" and for forming a 
probability difference matrix therefrom, 

a probability product difference calculator for producing a probability 
1 5 product difference for each row of said low density parity check matrix, 

an updater for updating said respective probability product difference 
and a respective entry of said probability difference matrix for each non-zero 
entry of said low density parity check matrix, 

a decoder for forming a decoded signal based on said updated 
20 probability difference matrix, and 

a parity check unit for checking the parity of said decoded signal. 
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16. A decoder according to claim 15, wherein said updater is 
operable to repeat said updating until either one of a group of conditions is 
fulfilled, said conditions being that said parity check unit indicates that said 
decoding is successful, and that a predetermined number of repetitions has been 
reached. 

17. A decoder according to claim 15, wherein said signal is a video 

signal 

18. A decoder according to claim 15, wherein said signal is a 
multimedia signal. 

19. A decoder according to claim 15, wherein said signal is a music 

signal. 

20. A decoder according to claim 15, which is part of a 3 rd generation 
wireless telephony device. 
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